Development and Validation of an Electronic Adverse Event Model for Patient Safety Surveillance in Interventional Radiology.

BACKGROUND: Comprehensive adverse event (AE) surveillance programs in interventional radiology (IR) are rare. Our aim was to develop and validate a retrospective electronic surveillance model to identify outpatient IR procedures that are likely to have an AE, to support patient safety and quality improvement. METHODS: We identified outpatient IR procedures performed in the period from October 2017 to September 2019 from the Veterans Health Administration (n = 135,283) and applied electronic triggers based on posyprocedure care to flag cases with a potential AE. From the trigger-flagged cases, we randomly sampled n = 1,500 for chart review to identify AEs. We also randomly sampled n = 600 from the unflagged cases. Chart-reviewed cases were merged with patient, procedure, and facility factors to estimate a mixed-effects logistic regression model designed to predict whether an AE occurred. Using model fit and criterion validity, we determined the best predicted probability threshold to identify cases with a likely AE. We reviewed a random sample of 200 cases above the threshold and 100 cases from below the threshold from October 2019 to March 2020 (n = 20,849) for model validation. RESULTS: In our development sample of mostly trigger-flagged cases, 444 of 2,096 cases (21.8%) had an AE. The optimal predicted probability threshold for a likely AE from our surveillance model was >50%, with positive predictive value of 68.9%, sensitivity of 38.3%, and specificity of 95.3%. In validation, chart-reviewed cases with AE probability >50% had a positive predictive value of 63% (n = 203). For the period from October 2017 to March 2020, the model identified approximately 70 IR cases per month that were likely to have an AE. CONCLUSIONS: This electronic trigger-based approach to AE surveillance could be used for patient-safety reporting and quality review.

Development of a Periprocedure Trigger for Outpatient Interventional Radiology Procedures in the Veterans Health Administration.

OBJECTIVES: Interventional radiology (IR) is the newest medical specialty. However, it lacks robust quality assurance metrics, including adverse event (AE) surveillance tools. Considering the high frequency of outpatient care provided by IR, automated electronic triggers offer a potential catalyst to support accurate retrospective AE detection. METHODS: We programmed previously validated AE triggers (admission, emergency visit, or death up to 14 days after procedure) for elective, outpatient IR procedures performed in Veterans Health Administration surgical facilities between fiscal years 2017 and 2019. We then developed a text-based algorithm to detect AEs that explicitly occurred in the periprocedure time frame: before, during, and shortly after the IR procedure. Guided by the literature and clinical expertise, we generated clinical note keywords and text strings to flag cases with high potential for periprocedure AEs. Flagged cases underwent targeted chart review to measure criterion validity (i.e., the positive predictive value), to confirm AE occurrence, and to characterize the event. RESULTS: Among 135,285 elective outpatient IR procedures, the periprocedure algorithm flagged 245 cases (0.18%); 138 of these had ≥1 AE, yielding a positive predictive value of 56% (95% confidence interval, 50%-62%). The previously developed triggers for admission, emergency visit, or death in 14 days flagged 119 of the 138 procedures with AEs (73%). Among the 43 AEs detected exclusively by the periprocedure trigger were allergic reactions, adverse drug events, ischemic events, bleeding events requiring blood transfusions, and cardiac arrest requiring cardiopulmonary resuscitation. CONCLUSIONS: The periprocedure trigger performed well on IR outpatient procedures and offers a complement to other electronic triggers developed for outpatient AE surveillance.

Arteriovenous Graft Failure in the Veterans Health Administration: Outcome Disparities Associated with Race.

Background Vascular access for ongoing hemodialysis often fails, frequently requiring repeated procedures to maintain vascular patency. While research has shown racial discrepancies in multiple aspects of renal failure treatment, there is poor understanding of how these factors might relate to vascular access maintenance procedures after arteriovenous graft (AVG) placement. Purpose To evaluate racial disparities associated with premature vascular access failure after percutaneous access maintenance procedures following AVG placement using a retrospective national cohort from the Veterans Health Administration (VHA). Materials and Methods All hemodialysis vascular maintenance procedures performed at VHA hospitals between October 2016 and March 2020 were identified. To ensure the sample represented patients who consistently used the VHA, patients without AVG placement within 5 years of their first maintenance procedure were excluded. Access failure was defined as a repeat access maintenance procedure or as hemodialysis catheter placement occurring 1-30 days after the index procedure. Multivariable logistic regression analyses were performed to calculate prevalence ratios (PRs) measuring the association between hemodialysis maintenance failure and African American race compared with all other races. Models controlled for vascular access history, patient socioeconomic status, and procedure and facility characteristics. Results In total, 1950 access maintenance procedures in 995 patients (mean age, 69 years ± 9 [SD], 1870 men) with an AVG created in one of 61 VHA facilities were identified. Most procedures involved African American patients (1169 of 1950, 60%) and patients residing in the South (1002 of 1950, 51%). Premature access failure occurred in 215 of 1950 (11%) procedures. When compared with all other races, African American race was associated with premature access site failure (PR, 1.4; 95% CI: 1.07, 1.43; P = .02). Among the 1057 procedures in 30 facilities with interventional radiology resident training programs, there was no evidence of racial disparity in the outcome (PR, 1.1; P = .63). Conclusion African American race was associated with higher risk-adjusted rates of premature arteriovenous graft failure after dialysis maintenance. © RSNA, 2023 Supplemental material is available for this article. See also the editorial by Forman and Davis in this issue.